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A fundamental problem in modern thermodynamics is how a molecular-scale machine performs 
useful work, while operating away from thermal equilibrium without excessive dissipation. To this 
end, we derive a friction tensor that induces a Riemannian manifold on the space of thermodynamic 
states. Within the linear-response regime, this metric structure controls the dissipation of finite- 
time transformations, and bestows optimal protocols with many useful properties. We discuss the 
connection to the existing thermodynamic length formalism, and demonstrate the utility of this 
metric by solving for optimal control parameter protocols in a simple nonequilibrium model. 
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Introduction. Molecular machines are microscopic 
objects that manipulate energy, matter, and information 
on the nanometer scale. Naturally-occurring machines 
are central to the performance of virtually any promi- 
nent cellular process, and the design of synthetic ma- 
chines holds out the promise for significant technologi- 
cal advances. A major impediment to quantitative un- 
derstanding of their thermodynamics is that molecular- 
scale machines typically operate out of thermodynamic 
equilibrium. For instance, the rotary i^oi^-ATPase mo- 
tor is powered by proton flow across a gradient produc- 
ing a free energy difference of ^200 meV per proton. 
This free energy difference dwarfs the characteristic en- 
ergy scale of thermal fluctuations under ambient condi- 
tions, lfceT ~ 25 meV (where fee is Boltzmann's con- 
stant and the temperature is T ~ 300 K), hence, the 
proton flux drives the machine out of equilibrium. In 
such contexts equilibrium statistical mechanics has lim- 
ited applicability and a nonequilibrium understanding of 
these machines is vital. Indeed, living processes with 
their preparation and preservation of order must, by their 
very nature, be out of equilibrium, leading Schrddinger 
to equate death with "the decay into thermodynamical 
equilibrium" [1]. 

A central figure of merit for both molecular and macro- 
scopic machines is thermodynamic efficiency: their abil- 
ity to exploit available energy from a source to perform 
useful work, while minimizing dissipation of heat into the 
surrounding environment. The importance of efficiency 
engenders an interest in understanding the basic physi- 
cal principles at play, the limits on efficiency in energy 
conversion, and the characteristics of optimal machines. 
In order to generate insights into biomolecular machine 
efficiency, insights that are transferable to the design of 
novel synthetic molecular machines, a general framework 
is necessary, one that abstracts away from many of the 
molecular details and instead focuses (at least initially) 
on criteria for optimal nonequilibrium processes. 

For macroscopic systems, the properties of optimal 
processes have been investigated using thermodynamic 
length, a natural measure of the distance between equi- 



librium thermodynamic states [2]. Its original deriva- 
tions, developed in the context of finite-time thermody- 
namics, considered the metrics on equilibrium manifolds, 
specifically the second derivatives of internal energy [2] , 
entropy [3] , or free energy [4] , all essentially equivalent in 
the thermodynamic limit [5] . Central results were derived 
under the assumption of endoreversibility [6], whereby 
the system and environment are in thermal equilibrium, 
though not necessarily equilibrated with each other. In a 
system driven by changes in a single control parameter, 
this amounts to the system trailing the environment, at 
any instant residing in an equilibrium corresponding to 
the system at a previous value of the control parameter. 
From these foundations, the second derivatives of inter- 
nal energy, free energy and entropy were shown to each 
impose a Riemannian metric structure on the equilibrium 
surface [6, 7]. 

Our aim is to adapt this framework to microscopic, 
nanoscale processes rather than the macroscopic pro- 
cesses for which it was originally formulated. Recent 
extensions have developed a microscopic formulation of 
thermodynamic length [8] with a metric tensor of Fisher 
information [9] (equivalent for thermodynamic systems 
to the equilibrium fluctuations of the conjugate force), 
and showed how to experimentally measure this quan- 
tity using work fluctuation relations [10]. In this pa- 
per we show that a microscopic and generalized formu- 
lation of thermodynamic length analysis can be derived 
directly from linear-response theory, without recourse to 
endoreversibility. The resulting thermodynamic metric 
structure imbues optimal processes with several impor- 
tant properties: optimal paths (those that minimize dis- 
sipation) are geodesies [11], dissipation is inversely pro- 
portional to protocol duration, the optimal control pa- 
rameter path is independent of duration, and optimal 
protocols perturb the control parameter so as to accu- 
mulate excess work at a constant rate [6, 12]. 

Derivation. Linear response is a standard frame- 
work for understanding fluctuations out of equilib- 
rium [13]. Here we derive a generalized thermodynamic 
length analysis from linear-response, without resort to 
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the assumption of endoreversibility. 

We assume a physical system in contact with a thermal 
bath. The probability distribution over microstates x at 
equilibrium is given by the canonical ensemble 



ir(x\ A) = exp /3[F(\) - E{x, A)] 



(1) 



where j3 = is the inverse temperature T 

of the environment in natural units, F(X) = 
— kBT\nJ2 x exp{— j3E(x, A)} is the free energy, and 
E(x, A) is the system energy as a function of the mi- 
crostate x and a collection of experimentally controllable 
parameters A of the system. In the case of a gas confined 
to a cylinder a control parameter could be the position 
of the piston imposing a particular accessible volume. 
For a single macromolecule stretched between two opti- 
cal traps, the control parameter could be the distance 
between the traps, imposing a harmonic energetic bias 
on the separation of the optical beads, between which 
the macromolecule is stretched. Control parameters can 
also represent collective variables, order parameters, or 
reaction coordinates. 

In equilibrium, the macroscopic state of the system 
(the probability distribution over microstates) is com- 
pletely specified by values of the control parameters, but 
out of equilibrium the system's probability distribution 
over microstates fundamentally depends on the history 
of the control parameter A, which we denote by the con- 
trol parameter protocol A. We assume the protocol is 
sufficiently smooth to be twice time-differentiable. 

As formulated this driving by a time-dependent Hamil- 
tonian can model a noncquilibrium steady state in the 
rest frame of a constantly-translating potential [14] or 
a driven damped harmonic oscillator that settles into a 
limit cycle. However it cannot treat a steady state, de- 
fined by time- independent probabilities for all system mi- 
crostates in the lab reference frame. Such a steady state, 
for example induced by planar shear, is more naturally 
modeled by including a nonconservative force and corre- 
sponding dissipativc flux [15]. 

We adopt natural definitions of heat and work [16, 17]: 
In accordance with the first law the average instanta- 
neous rate of energy flow into the system, d(E)\/dt, is 
the sum of the average instantaneous rate of heat flow Q 
from the environment into the system, 



d(Q) A = /dx^_ 8E\ 
dt \ dt dx / A 



(2) 



and the average instantaneous power V (rate of work W) 
due to the external perturbation of the control parame- 
ters A, 



d(W) A 
dt 



dX 1 

dt 



(X)a 



(3) 



Here X = —dE/dX is the vector of forces conjugate to 
the control parameters A, and angular brackets with sub- 



script A denote a noncquilibrium average over the ensem- 
ble following the control parameter protocol A. For the 
macromolecule with the trap position as the control pa- 
rameter, the corresponding conjugate force would be the 
tension with which extension is resisted by the entire con- 
struct of a macromolecule, attached handles, and optical 
beads [10]. 

For a system initially at equilibrium at time to and 
control parameters X(to), the average heat flow vanishes, 
and the average power is 



d>J 

dt 



/A(to) 



(4) 



where the angled brackets with subscript A(io) denote an 
ensemble average at fixed control parameters A(io). 

Thus for a system at time to, following an arbitrary 
noncquilibrium protocol A with current control parame- 
ter values X(to), the average excess power exerted by the 
external agent on the system, over and above the average 
power on a system initially at equilibrium, is 



V ex (t ) 



dX 1 

dt 



(AX(to)) A 



(5) 



where AX(f ) = X(£ ) — (^)x(t ) is the deviation of the 
conjugate forces X at time to from the average conjugate 
forces X at equilibrium under control parameter X(to). 

To first order in the magnitude of the external per- 
turbation, dynamic linear-response theory expresses the 
deviation of the conjugate forces from equilibrium as an 
integrated response to the perturbation [18], 



(AX(t )) A 



dt' X (to - t') ■ [A(i') - X{to)\ , (6) 



where Xij(t) = j3 cZEy *°"(t)/di represents the response 
of conjugate force Xj at time t to a perturbation in con- 
trol parameter A 1 at time zero, and 



,(A(to)) 



(7) 



is the coefficient of the covariance matrix £( A (*°))(i) for 
conjugate forces Xj and Aj separated by time t, at con- 
stant control parameters X(t ). This approximation as- 
sumes that, over timescales where the response function 
dJjW'o)) (fj j 'dt\ T is significantly different from zero, both 
the noncquilibrium response (AX(£o))a and the equilib- 
rium change (X)^( to ) — (X)^( to _ T ) arc linear in the control 
parameter change X{to) — X{to — r). 

Substituting Eq. (6) into Eq. (5) simplifies the noncqui- 
librium expectation: 



Pex(to) = P 



dX 1 

dt 



(8) 



dt 



,dE( A (*°))(i -*') 



dt' 



[X(t )-X(t')} 
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Integration by parts gives 



Pex(to) = P 



dX 1 



dt 



d\ 



dt 



(9) 

where the boundary term at t' = to vanishes triv- 
ially, and the one at t' = — oo vanishes given that 
linV-^-oo £ (A( * o)) (i - t') ■ \{t') = 0. This is satisfied, 
for example, when the system is initially at equilibrium. 

We change integration variables to t" = to — f and 
Taylor expand the control parameter velocities at time 
to — t" around their values at to, 



dX 

~dt 



dX 

~dt 



- O 



d 2 X 



dt 2 



(10) 



When the control parameter velocities change on 
timescales slower than the relaxation time of the system's 
force fluctuations, we can keep only the constant term, 
yielding 



dX 7 



dt 



•/? / dt"^ x ^\t")- 

to Jo 



dX 
~dt 



(11) 



to 



This analysis collapses the integral of the time- 
dependent covariance matrix into a single time- 
independent (equilibrium) matrix £(A(io)) with entries 



Cy(A(i )) =/3 



dt" ££ (4o)) (t") 



(12a) 



= 13 df'iSXj^SXiit"))^ . (12b) 
Jo 

This time-integrated force covariance matrix is the Kirk- 
wood formulation of the friction tensor [19, 20]. 

We arrive at our central relations. The nonequilibrium 
excess power V ex along the protocol is determined by the 
friction tensor and experimentally controlled parameter 
velocities, 



V ex (t ) 



dX 1 



dt 



C(A(to)) 



dX 

lit 



(13) 



This expression is entirely local: although in general 
nonequilibrium properties depend on the perturbation 
history, our relation only depends on the instantaneous 
values of the control parameter and its derivative. 

The integral of the excess power over the con- 
trol parameter protocol gives the mean excess work, 
Wox = J dtV cx (t). This is the difference between 
the work the external agent does on the system dur- 
ing the nonequilibrium protocol and the work that would 
have been done if the protocol had been performed qua- 
sistatically, so that the system remained at equilibrium 
throughout. It follows from Eq. (13) that the excess 
power scales as \dX/dt\ 2 and, for a given total transition 
time At, the excess work scales as \dX/dt\. 



In general, at the conclusion of the protocol some frac- 
tion of this excess work will have been dissipated as heat 
to the environment, and the remaining fraction remains 
in the system, as an excess energy associated with being 
instantaneously out of equilibrium [21]. If at the conclu- 
sion of the protocol the system is allowed to fully equi- 
librate, all this remaining energy will be dissipated, and 
thus the excess work will equal the dissipation. 

Any covariance matrix is symmetric and positive- 
semidefinite [22], and the conjugate-force covariance ma- 
trix £( A ( to »(t) varies smoothly with control parameter 
values (except at macroscopic phase transitions). It fol- 
lows that the friction tensor £(A(io)), the time-integral 
of X( x (* ))(t), is symmetric, positive-semidefinite, and 
smoothly varying except at macroscopic phase transi- 
tions. Therefore the friction tensor £ induces a Rieman- 
nian manifold on the space of thermodynamic states [23] . 
Furthermore, positive-semidefiniteness of the friction ten- 
sor £ guarantees that excess power and work are non- 
negative, consistent with the second law. 

This metric endows protocols with a number of use- 
ful properties. It defines a generalized thermody- 
namic length, C = J Q t dt ^/V cx (t) and divergence J = 

At J Q dtV ex (t). The excess work is proportional to 
the thermodynamic divergence along the protocol, J = 
At W ex - For a fixed control parameter path, the cor- 
responding thermodynamic length is independent of the 
time interval At and the relative control parameter ve- 
locities en route, and places a lower bound on the excess 
work, W ox > L 2 1 At. By the Cauchy-Schwarz inequal- 
ity, this bound is only realized for a protocol with a con- 
stant excess power [6, 8]. 

Under a Riemannian metric the shortest paths (and 
therefore in our case the optimal, minimum excess work 
protocols) are geodesies, the closest thing to a straight 
line in a curved manifold. This property should simplify 
the discovery of optimal protocols in complicated energy 
landscapes. Moreover, from the definition and scaling of 
the thermodynamic length and divergence, it follows that 
the control parameter path of an optimal protocol is inde- 
pendent of the protocol duration. Increasing or decreas- 
ing the duration does not change the optimal path in the 
linear-response regime. Finally, we note that the metric 
structure ensures that the excess work will be invariant 
to linear transformations of the control parameters. 

Discussion. The present formalism generalizes sev- 
eral other frameworks in the existing literature on ther- 
modynamic length. The control parameter friction tensor 
can be decomposed into 



C(A(to)) =fc B TT(A((„))oI(A((„)) 



(14) 



the Hadamard product (entry-by-entry product) 'o' of 
the integral relaxation time matrix t and the Fisher in- 
formation matrix X, scaled by k^,T. The Fisher informa- 
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tion is defined as [24] : 



2y(A) 



91n7r(a;|A) <91n7r(x|A) 



dX 1 



(15) 



For a system in thermal equilibrium (1), this simplifies to 
1 (SXj 5Xi)~, the covariance of the forces conjugate to 
control parameters A* and A- 7 ' [8] . The integral relaxation 
time [25], 



(A) 



dt" 



(SXj 5Xi)x 



(16) 



generalizes to multiple dimensions and noncxponcntial 
relaxation kinetics the more familiar relaxation time 
t' ) (the time constant in exponential relaxation ki- 
netics where correlations decay over time according to 
cxpH/rW]). 

Equation (13) allows for an integral relaxation time 
that varies with the current control parameter value. 
When the relaxation time does not vary with the control 
parameter, the Riemannian metric reduces to the Fisher 
information metric [26] , recovering the microscopic ther- 
modynamic length formulation of [8]. Nevertheless, the 
generalization to varying integral relaxation time is im- 
portant, as in many systems we expect the relaxation 
time to vary substantially, especially near transition in- 
terfaces separating metastable basins of attraction. 

In general the Fisher information is related to Schlogl's 
metric, the second derivative of the free entropy ip = 
-0F, by Z(A) = + (^|#). The last term van- 

ishes when the energy is linear in the control parameters, 
when the control parameters are intensive, or when the 
control parameters are extensive in the macroscopic limit. 
In these limits, we recover the original formalism as the 
differential geometry of thermodynamic potentials [2-5] . 

Expressing the metric in terms of a friction tensor in 
thermodynamic state space helps clarify the nature of 
thermodynamic length. Roughly speaking, this friction 
represents the resistance of the system to control param- 
eter changes that are imposed in finite time. According 
to Eq. (13), for a fixed control parameter velocity dX/dt, 
the excess power is greater where the control parameter 
friction coefficient £ is greater. Hence the excess work 
is reduced when the protocol proceeds slower in regions 
of a high friction coefficient, which can occur when the 
relaxation time or equilibrium fluctuations are large. 

In Cartesian space, the friction tensor (also known as 
the inverse diffusion tensor) has been posited as a metric 
tensor [27-29], and used to understand the connectivity 
of white matter in the brain [30] and the paths of elec- 
trical excitation waves in cardiac tissue [31]. de Koning 
and Antonelli [32] derived a similar expression for excess 
work (but assumed simple exponential relaxation time) 
using similar linear-response arguments. Tsao, et al. [33] 
derived a similar expression assuming endorevcrsibility 



(but with the integral relaxation time replaced by the en- 
doreversible lag time, the elapsed time since the control 
parameters had values for which the current distribution 
over microstates is an equilibrium distribution). The case 
of nonexponcntial kinetics, the connections to thermody- 
namic length analysis, and the interpretation in terms of 
a friction tensor in thermodynamic state space have not 
to our knowledge been previously reported. 

Applications. We now demonstrate a simple ex- 
pression for the control parameter protocol that mini- 
mizes the excess work for a system with one control pa- 
rameter, given that it must transition between points A a 
and Ah in fixed time At. The optimal control parameter 
protocol is found via the Euler-Lagrange equation [34] 
for this problem, with cost function f(X(t), A) = £(A) A 2 , 



= 



dj_ _ d_ 

dX dt 



dX 



-2C(A) X - C'(A) A 2 



This has the solution 



X opt (t) = 



(X b -X a ) c(x(t)y 
f At dt>((X(t>))- 



C(A(t))" 



(17) 



(18) 



Thus, in the single control parameter case, the optimal 
protocol proceeds with a velocity inversely proportional 
to the square root of the control parameter friction, eval- 
uated for the current value of the control parameter, 
and hence [using Eq. (13)] has a constant excess power. 
Where the system experiences large friction in thermody- 
namic state space, the optimal control parameter proto- 
col will change slowly. The time interval At only sets the 
proportionality constant, but not the relative velocities 
at different points in the protocol. 

The general multiple-parameter case does not admit 
of a straightforward optimization. But we can extend 
our analysis to the optimization of a particular two- 
parameter protocol: a particle diffusing in a harmonic 
potential according to the overdamped Langevin equa- 
tion with Cartesian friction coefficient £ c , with control 
parameters the location y and spring constant k of the 
harmonic potential. We perturb the system from (y a , k a ) 
to (jjb, kb) in a fixed time interval At. The control pa- 
rameter friction tensor is 



c = 



; c o 

U 4/3 fc 3 



(19) 



Since this matrix is diagonal, and the k, k term is in- 
dependent of y and the y, y term is independent of k, 
the protocol can be optimized for each control param- 
eter separately using Eq. (18), yielding for the optimal 
protocol 



d_ _ Vb - Va 
dt V ~ At 



4 fc~ 1/2 = 2* J* . (20) 



dt 



At 
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Under the optimal protocol the trap center and inverse 
square root of the spring constant each change at a con- 
stant rate, independent of time. This corresponds to 
changing the equilibrium mean and standard deviation 
of position at a constant rate. 

Seifcrt and coworkers elegantly derived the exact opti- 
mal protocols for perturbing the position and spring con- 
stant separately, for both over-damped [35] and under- 
damped [36] Langcvin dynamics. Their analysis found 
optimal protocols similar to ours but with discrete con- 
trol parameter jumps at the beginning and end of the 
protocol (though these jumps are smoothed to bound- 
ary layers under regularization that penalizes accelera- 
tion [37]). Our method misses such protocol jumps be- 
cause our derivation assumes that the velocities of proto- 
cols change smoothly. Other than the discrete jumps at 
the boundaries, our approximation produces results that 
near equilibrium differ from optimal values by, to leading 
order, a dimensionless measure of distance from equilib- 
rium, £ c /(kAt). Such exact results are useful where they 
are tractable, but the thermodynamic metric provides a 
convenient, general computational framework, especially 
in complex systems. 
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